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DETAILED ACTION 
Claim Rejections - 35 USC §112 

1. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

2. Claims 9-15, 21, and 184-185 are rejected under 35 U.S.C, 112, second paragraph, as 
being indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention, 

3. Claim 9 recites the limitation "said first user" in line 12 of the claim. There is insufficient 
antecedent basis for this limitation in the claim. It is unclear if the first user is the same as the 
subject user. 

4. Claims 184-185 recite the limitation "the link defining a transition possibility" in lines 1- 
2 of the claims. There is insufficient antecedent basis for this limitation in the claims. 

Claim Rejections - 35 USC § 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 
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6. Claims 1-10, 15-16, 21-28, 32-39, 41-49, 61-67, 71-79, 84-94, 99-100, 105-112, 116-123, 
125-133, 145-151, 156-164, 179-181, and 183-187 are rejected under 35 U.S.C. 102(e) as being 
anticipated by U.S. Patent No. 6,507,353 to Huard et al. (hereinafter Huard). 

Referring to claims 1, 39 1 , 85, and 123, a software application including a personal 
narrative agent [s] (actor with behavior module and action generator; col 3, line 3 1 and Fig. 2, 
Actor 1 box) for providing instructions to one or more processors to create and manage multiple 
dynamic customized story experiences (actor actions in environment) for a subject user in a user- 
observable environment having at least one object with which the subject user may interact (i.e. 
new actors; col. 3, line 58 - col. 4, line 1 1), the one or more processors permitting the personal 
narrative agent (actor) to perform the steps of: 

selectively interacting with said at least one object to manipulate the environment in 
furtherance of the story experiences (i.e. col, 6, lines 21-32); 

maintaining data relating to the subject user (i.e. sonic, positional, and haptic data; col. 3, 
lines 21-42 and col 4, lines 12-50), the environment and the multiple story experiences of the 
subject user; and simultaneously managing each of said multiple story experiences (i.e. actor 
behaviors) each of which reaches its own narrative conclusion consistent with input and 
characteristics of the subject user (visitor) and any objects (other actors or objects in the 
environment) selected to influence said story experiences. See col. 2, lines 14-37 and col. 6, 
lines 22-43. Huard describes how the actions of the actors (i.e. fish, animals, or plants) are 
influenced by the visitor and other objects in the environment, which results in a story 
(presentation) of how the animals interact with their surroundings. 



1 Claims 39 and 123 contain limitations similar to those found in claims 1, 9, and 10. 
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Referring to claims 9, 28, 39, 67, 123, and 151, Huard further includes a second [and 
third] personal narrative agent (second actor with behavior module) for providing instructions to 
one or more processors to create and manage one or more (multiple) dynamic customized story 
experiences for a second user [each user] (and their computer-controlled character/actor) in said 
user-observable environment having the at least one object with which the second user may 
interact, the one or more processors permitting the second personal narrative agent to perform 
the steps of: 

selectively interacting with the at least one object (i.e. other actor or stimuli) to 
manipulate the environment in furtherance of the story experiences of the second user (i.e. col. 3, 
lines 44-57 and col. 4, lines 1-11); 

maintaining data relating to the second [third] user (and their computer-controlled 
character/actor) (col. 3, lines 58-60), the environment and the story experiences of the second 
user (and their computer-controlled character/actor); and simultaneously managing each of said 
story experiences of said second user (and their computer-controlled character/actor) 
independent of said story experiences of said first user (i.e. no stimuli between the first and 
second actor), and each of which reaches its own narrative conclusion consistent with input and 
characteristics of the second user (and their computer-controlled character/actor) and any objects 
selected to influence said story experiences of said second user, such as to enable said second 
user (and their computer-controlled character/actor) to pursue individual stories independent 
from the stories of the first user [and second user]. 

As examples, the interactive theater of Huard may be used with a first visitor and a first 
actor (i.e. a beluga; col. 8, lines 26-33) and then used with a second visitor and a second actor 
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(i.e. other animal; col. 4, lines 55-61) wherein the second visitors experience (story) is 
independent to the first visitors. This may repeat for a third user. Or both a first and second [and 
third] visitor may interact with two [three] actors (animals) in the same environment, wherein 
actors/animals decide not to interact with each other (col. 4, line 4). Also, see col. 1, lines 54-67. 

Referring to claims 10, 16, 39, and 123, Huard discloses that the one or more processors 
permit the personal narrative agent of the subject user to perform the further step of negotiating a 
story opportunity involving said second user for the subject user with said second personal 
narrative agent uniquely assigned to the second user consistent with said one or more story 
experiences of said subject user. See col 4, lines 1-11. 

Referring to claims 38 and 122, Huard teaches a software application for providing 
instructions to one or more processors to create and manage one or more dynamic customized 
story experiences for each of multiple users wherein a unique personal narrative agent (actor 
with behavior module and action generator; col. 3, line 31 and Fig. 2, Actor 1 and Actor N 
boxes) is assigned to assist each user throughout the story experiences of the user in a user- 
observable environment (virtual environment) having at least one object with which the users 
may interact (i.e. new actors; col. 3, line 58 - col 4, line 1 1), the one or more processors 
permitting a first and a second personal narrative agents which are respectively assigned to a first 
and a second users to perform the steps of: 

selectively interacting with said at least one object to manipulate the environment in 
furtherance of said story experiences, including independently managing different story 
opportunities for the first and second users, respectively, consistent with said one or more story 
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experiences of said first user and said one or more story experiences of the second user (i.e. col. 
4, lines 1-11 and col. 6, lines 21-32); 

maintaining data relating to the first and second users (i.e. sonic, positional, and haptic 
data; col 3, lines 21-42 and col. 4, lines 12-50), respectively, and the one or more story 
experiences of the first and second users, and of the environment; and managing each of said one 
or more story experiences (i.e. actor behaviors) of said first and second users, respectively, to its 
own narrative conclusion consistent with input and characteristics of the first and second users 
and any objects selected to influence said one or more story experiences, such as to enable each 
of said first and second users to pursue individual stories independent from the stories of the 
other user. 

As examples, the interactive theater of Huard may be used with a first visitor and a first 
actor (i.e. a beluga; col. 8, lines 26-33) and then used with a second visitor and a second actor 
(i.e. other animal; col. 4, lines 55-61) wherein the second visitors experience (story) is 
independent to the first visitors. Or both a first and second visitor may interact with two actors 
(animals) in the same environment, wherein actors/animals decide not to interact with each other 
(col. 4, line 4). Also, see col 1, lines 54-67. 

Referring to claims 2, 41, 86, and 125, the one or more processors of Huard permit the 
personal narrative agent to perform the further step of maintaining an awareness of possible story 
opportunities (i.e. virtual environment database) for the subject user, activities which could 
trigger those stories from those opportunities, and activities which could advance those stories. 
See col. 3, line 58 - col. 4, line 11. 
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Referring to claims 3, 42, 87, and 126, the one or more processors of Huard permit the 
personal narrative agent to perform the further step of maintaining an awareness of possible 
objects (i.e. other actors or stimulus) that could trigger and/or advance those stories. See col. 3, 
line 58 - col. 4, line 1 1 and col. 6, lines 22-42. 

Referring to claims 4, 43, 88, and 127, wherein the possible objects in Huard include a 
character (actor) corresponding to a second user. See col. 3, lines 3-7 and lines 58-67. 

Referring to claims 5, 44, 89, and 128, the one or more processors of Huard permit the 
personal narrative agent to perform the further steps of: 

maintaining a personal data store (database) of information relating preferences of the 
subject user (visitor information); and 

offering a story opportunity to the subject user based on information of said personal data 
store. See col. 4, lines 12-50. 

Referring to claims 6, 45, 90, and 129, the one or more processors of Huard permit the 
personal narrative agent to perform the further steps of: 

monitoring the activities of the subject user (i.e. col. 3, lines 21-31 and col 4, lines 12- 
28); and 

offering a story opportunity (actor actions in an environment) to the subject user based on 
information gathered from said monitoring of said activities of the subject user. See col. 3, line 
44 - col. 4, line 59 and col. 8, lines 50-55. 

Referring to claims 7, 46, 91, and 130, the one or more processors of Huard permit the 
personal narrative agent to perform the further step of storing data about user (visitor) activities. 
See col. 4, lines 18-40. 



Application/Control Number: 09/723,607 Page 8 

Art Unit: 2173 

Referring to claims 8, 47-48, 92, and 131-132, the information of Huard is further used 
for evolving a story (scene of animal interaction). For example, see col. 3, lines 31-33 and col. 5, 
lines 1-14. 

Referring to claims 9, 28, 93, and 1 12, Huard further includes a second personal 
narrative agent (second actor with behavior module) for providing instructions to one or more 
processors to create and manage one or more dynamic customized story experiences for a second 
user (and their computer-controlled character/actor) in said user-observable environment having 
the at least one object with which the second user may interact, the one or more processors 
permitting the second personal narrative agent to perform the steps of: 

selectively interacting with the at least one object (i.e. other actor or stimuli) to 
manipulate the environment in furtherance of the story experiences of the second user (i.e. col 3, 
lines 44-57 and col, 4, lines 1-1 1); 

maintaining data relating to the second user (and their computer-controlled 
character/actor) (col. 3, lines 58-60), the environment and the story experiences of the second 
user (and their computer-controlled character/actor); and simultaneously managing each of said 
story experiences of said second user (and their computer-controlled character/actor) 
independent of said story experiences of said first user (i.e. no stimuli between the first and 
second actor), and each of which reaches its own narrative conclusion consistent with input and 
characteristics of the second user (and their computer-controlled character/actor) and any objects 
selected to influence said story experiences of said second user, such as to enable said second 
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user (and their computer-controlled character/actor) to pursue individual stories independent 
from the stories of the first user. 

As examples, the interactive theater of Huard may be used with a first visitor and a first 
actor (i.e. a beluga; col. 8, lines 26-33) and then used with a second visitor and a second actor 
(i.e. other animal; col. 4, lines 55-61) wherein the second visitors experience (story) is 
independent to the first visitors. Or both a first and second visitor may interact with two actors 
(animals) in the same environment, wherein actors/animals decide not to interact with each other 
(col. 4, line 4). Also, see col. 1, lines 54-67. 

Referring to claims 10, 16, 49, 94, 100, 105, and 133, Huard discloses that the one or 
more processors permit the personal narrative agent of the subject user to perform the further 
step of negotiating a story opportunity involving said second user for the subject user with said 
second personal narrative agent uniquely assigned to the second user consistent with said one or 
more story experiences of said subject user. See col. 4, lines 1-11. 

Referring to claims 186-187, the negotiation in Huard can involve multiple users (i.e. a 
third user). See col. 4, lines 1-11. 

Referring to claims 15, 21, and 99 Huard discloses the one or more processors permit 
each personal narrative agent to perform the further steps of modifying the presentation of the 
environment to its respective user to further said one or more story experiences. See col. 3, lines 
58-60. 

Referring to claims 22, 61, 106, and 145, Huard discloses the one or more processors 
permit the personal narrative agent to perform the further step of managing scenes (i.e. col. 1, 
lines 38-54). 
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Referring to claims 23, 62, 107, and 146, Huard discloses the one or more processors 
permit the personal narrative agent to perform the further step of managing transitions between 
scenes (i.e. renderings; col. 3, lines 44-56). 

Referring to claims 24, 63, 108, and 147, Huard discloses the one or more processors 
permit the personal narrative agent to perform the further step of managing transitions between 
scenes where the last scene and the next scene are in different stories (i.e. a first story with a 
beluga; col. 8, lines 26-33 and then another animal; col. 4, lines 55-61). 

Referring to claims 25, 64, 109, and 148, Huard discloses the one or more processors 
permit the personal narrative agent to perform the further step of managing scenes which further 
more than one story experience (i.e. more than one actor observance) within a single scene, 
thereby weaving said story experiences together (i.e. the experiences of more than one 
animal/actor). See col. 6, lines 34-42. 

Referring to claims 26, 65, 1 10, and 149, Huard discloses the one or more processors 
permit the personal narrative agent to perform the further step of modifying the presentation of 
the environment to the user to further said story experiences (environment update; col. 3, line 
59). 

Referring to claims 27, 66, 111, and 150, Huard discloses the one or more processors 
permit the personal narrative agent to perform the further step of modifying the environment to 
further said story experiences (environment update; col. 3, line 59). 

Referring to claims 32, 71, 116, and 155, Huard teaches that the one or more processors 
permit the personal narrative agent to perform the further steps of: 
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recognizing story patterns (i.e. reactions) in actions of said subject user (i.e. col. 4, lines 
12-50); and 

creating and managing story experiences consistent with those patterns. See col. 6, lines 

33-43. 

Referring to claims 33, 72, 1 17, and 156, Huard discloses the one or more processors 
permit the personal narrative agent to perform the further step of maintaining consistency of said 
story experiences with a previous active story (i.e. previous wildlife experience). See col, 3, 
lines 58-67, which describe keeping a database of all story experiences. 

Referring to claims 34, 73, 118, and 157, Huard discloses the one or more processors 
permit the personal narrative agent to perform the further step of creating stories based on 
narrative forms (i.e. grammars), said narrative forms defining structures and themes of said 
stories. See col. 9, line 63 - col. 10, line 5. 

Referring to claims 35, 74, 1 19, and 158, Huard discloses the one or more processors 
permit the personal narrative agent to perform the further step of creating multiple distinct stories 
based on multiple narrative forms. See col. 9, line 63 - col. 10, line 5, which shows each animal 
will have its own grammar that controls its behavior (story). 

Referring to claims 36, 75, 120, and 159, Huard teaches that the one or more processors 
permit the personal narrative agent to perform the further step of transforming a story based on a 
first narrative form into a story based on a second narrative form (i.e. the grammar of the actor 
may evolve). For example, see col. 1, lines 54-67 and col. 4, line 66 - col. 5, line 14. 
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Referring to claims 37, 76, 121, and 160 Huard discloses the one or more processors 
permit the personal narrative agent to perform the further step of creating multiple distinct stories 
based on a single narrative form. For example, more than one of the same type of actor (animal) 
may be present. See col. 4, lines 1-11. 

Referring to claims 77 and 161, Huard discloses the one or more processors permit the 
personal narrative agent to perform the further steps of: 

determining events (i.e. col. 6, lines 13-18) that tend to cause a story to be consistent with 
a first narrative form (behavior, grammar, or state of the actor - i.e. sleepy or aware; col. 5, lines 
1-14); and 

managing said story including manipulating said at least one object and said environment 
to provide one or more opportunities for said subject user to follow a story consistent with the 
first narrative form. For example see col. 6, lines 23-43. 

Referring to claims 78-79 and 162-163, Huard discloses the one or more processors 
permitting the personal narrative agent to perform the further steps of: 

determining events that tend to cause said story experiences to be inconsistent with the 
first narrative form (i.e. stimuli that cause a reaction/new narrative form; col. 6, lines 22-32); 

finding or generating a second narrative form, for which said events are consistent; and 
transforming the story in to an instance of said second narrative form (i.e. state of the actor as a 
result of the stimuli). See col, 6, lines 23-43. 
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Referring to claims 84 and 164, the environment of Huard is simulated (a virtual 
environment). See col. 2, lines 14-19. 

Referring to claim 179, Huard discloses the one or more processors permit each personal 
narrative agent to perform the further step of creating and managing one or more of said stories 
(i.e. decision layers) consistent with one or more larger narrative arcs (outer decision layers). 
See col. 5, lines 56-64. As another example, see col. 13, lines 10-47, which describe an 
environmental element within the Environment, which is within the Virtual World (larger 
narrative arc). 

Referring to claims 180-181, said stories (showing of reactions) are elements of a larger 
narrative arc (decision layer). See col. 5, lines 56-64. As another example, see col. 13, lines 10- 
47, which describe an environmental element within the Environment, which is within the 
Virtual World (larger narrative arc). 

Referring to claim 183, Huard discloses the one or more processors permit each personal 
narrative agent to perform the further step of managing one or more stories for multiple users. 
As an example, the interactive theater of Huard may be used with a first visitor and a first actor 
(i.e. a beluga; col. 8, lines 26-33) and then used with a second visitor and a second actor (i.e. 
other animal; col. 4, lines 55-61). 

Referring to claims 184-185, the link defining a transition possibility between said first 
narrative form and said second narrative form is modular (i.e. is a behavior and biophysical 
modules; col. 3, lines 20-56. 

Claim Rejections - 35 USC § 103 
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7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

8. Claim 182 is rejected under 35 U.S.C. 103(a) as being unpatentable over Huard. 
Referring to claim 182, Huard describes a virtual world embodied in an interactive 

theater (col. 3 ? lines 4-16), which implies but does not explicitly teach the one or more 
processors permitting each personal narrative agent to perform the further steps of: 

storing the state of said stories; and 

restoring said stories from their saved state. 

It is well known in the art that animation (virtual environments) played in interactive 
theaters may be paused (which stores the state of the story) and restarted (which restores the 
story). The Examiner takes Official Notice of this teaching. It would have been obvious to one 
of ordinary skill in the art to provide the capability to pause and replay the virtual environment of 
Huard in order to let the user study a specific image of the user or pause for lecture as described 
in Huard (col. 2, lines 38-53), 

9. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 
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10. Claims 11-14, 17-20,29-31,40, 50-60, 68-70,95-98, 101-104, 113-115, 124, 134-144, 
and 152-155 are rejected under 35 U.S.C. 103(a) as being unpatentable over Huard and U.S. 
Patent No. 6,396,509 to Cheng. 

Referring to claims 11-14, 17-20, 40 2 , 50-60, 95-98, 101-104, 124, and 134-144, Huard 
discloses that the one or more processors permitting the personal narrative agent of the subject 
user to interact with both objects in the environment and the second personal narrative agent (i.e. 
col. 3, line 58 - col. 4, line 11 and col. 6, lines 21-32) which implies but does not explicitly teach 
the ability to perform the further step of negotiating for use of one or more objects with said 
second personal narrative agent uniquely assigned to said second user, said objects being used in 
one or more story experiences of one or both of said subject and second users. 

However, Cheng teaches a method that uniquely assigns personal agents (avatars and 
bots) to a user, which are similar to the actors of Huard, that negotiate (resolve conflict) with 
other users' agents (avatar or bot) for use of an object that is used in a story (virtual 
entertainment) experience of one or both of the users. See Cheng at col. 1, lines 35-60, col. 25, 
lines 32-48, and col. 26, lines 17-25, which describes how priority (conflict resolution) for 
objects is determined (negotiated) between avatars, wherein the priority (negotiation) may be 
determined by economic models and cost structures (i.e. market mechanism, bidding, etc.) and 
parameters set by a participant (user input). It would have been obvious to one of ordinary skill 
in the art to include the priority component of Cheng in the virtual theater of Huard in order for 
the actors to negotiate for use of an object found in the virtual environment as set forth in Cheng, 
such that conflicting interest in an object may be resolved as taught by Cheng. 
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Referring to claims 29-30, 68-69, 1 13-1 14, and 152-153, Huard discloses that the one or 
more processors permit interaction between the second [or third] personal narrative agent and the 
second user, but Huard does not explicitly teach the second personal narrative agent perform the 
further step of reverting computer-control of the computer-controlled character to control by a 
second user, wherein said character continues to pursue one or more story experiences previously 
controlled by computer-control. However, Cheng teaches personally assigned agents (i.e. an 
avatar/character representing the subject user) that may be controlled by a participant (user) or 
act autonomously (computer-controlled). See Cheng at col. 4, lines 41-64. It would have been 
obvious to one of ordinary skill in the art to revert control of the computer-controlled character 
(actor) in Huard to control by the second [or any] user and vice versa (i.e. revert control from a 
[subject] user to computer control) as taught in Cheng, to allow the second user direct 
participation in the virtual environment or autonomous action as supported by Cheng. 

Referring to claims 3 1, 70, 1 15, and 154, Huard teaches associating characters with users 
(i.e. col. 1, lines 38-53), but Huard does not explicitly teach a first character object represents 
said subject user in the environment, and a second character object represents a second user in 
the environment, and said second character object is controlled and managed by said second 
user, said second character object not being associated with a second personal narrative agent. 
However, Cheng teaches representing users in a virtual environment with avatars (characters), 
wherein an avatar may be completely controlled by a participant (i.e. second character object has 
no narrative agent). See Cheng at col. 1, lines 35-60 and col. 4, lines 35-48. It would have been 
obvious to one or ordinary skill in the art to provide avatars to represent each user in the virtual 



2 Claims 40 and 124 contain limitations similar to those found in claims 1, 9, and 11, Because claim 1 1 depends 
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theater of Huard, such that a second avatar (character) has no narrative agent (is completely 
controlled by a participant) to create interaction with a user-controlled virtual stimulus as shown 
in Cheng. 

Conclusion 

1 1 . The prior art made of record on form PTO-892 and not relied upon is considered 
pertinent to applicant's disclosure. Applicant is required under 37 C.F.R. § 1. 1 1 1(c) to consider 
these references fully when responding to this action. The documents cited therein teach 
methods of using personal agents and methods of creating stories or generating scenes. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Shawn M. Becker whose telephone number is (703) 305-7756. 
The examiner can normally be reached on M-F 8:30-6:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John W. Cabeca can be reached on (703) 308-3 116. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



from both claims 9 and 1, it includes each limitation in claim 40. 
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